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O BACKGROUND OF THE INVENTION 

lU 

12 

1 3 Field of the Invention 
14 

1 5 The invention relates to delivering web pages and other objects from a server, us- 

1 6 ing techniques such as predictive predownload and delta encoding. 
17 

18 
19 
20 
21 
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1 Related Art 
2 

3 When serving web pages and other objects from a web server, it is advantageous 

4 to substantially minimize the amount of time needed to send those objects from the server to the 

5 requesting client (also known as a browser). 
6 

7 One method includes attempting to maintain template information already known 

to the client, and to send only delta information from the server to the client. However, the tem- 
plate information must be determined and sent to the client after the client has requested a corre- 

"•5 J: 

tf) spending web page. This method suffers from the drawback that it does not substantially mini- 

tiil mize the amount of time required to present the page to a client as because the template informa- 

i: is;? 

iJ2 tion, the delta information (or both) are not sent to the client as soon as possible. 

m 

|h Another method is to predownload web pages or other objects from the server to 

1 5 the cHent. This method includes selecting one or more next objects the client is likely to request, 

1 6 and sending those next objects from the server to the client in a predownload time before the cli- 

17 ent actually requests those next objects. However, this suffers from the drawback that if the se- 

1 8 lected next objects take a relatively long time to predownload, there is a substantial chance they 

1 9 might not be ftiUy received before the client makes its next request. 
20 
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1 SUMMARY OF THE INVENTION 

2 

3 The invention includes a method and system which substmitially minimizes the 

4 time needed to send and present objects from a server to a client^ such as by using techniques for 



5 predictive predownload of templates with delta encoding. In one embodiment, a template 

6 builder generates a set of templates for each web page or other object. A prediction engine main- 

7 tains a prediction map, responsive to web pages and other objects, the objects including the tem- 
I J plates for web pages. The prediction engine selects one or more next objects likely to be re- 

^ quested by the client making the particular request, such as a next object or an object embedded 

CO in or referenced by a page. A delta encoder for a web page determines delta information in re- 

. pi: 

|4 sponse to a current version of that page, and template information for that page, and encodes the 

%2 web page for delivery to the client using the template information and delta information. The 

Jtt cUent is able to present the object in response to both the template information and deha informa- 

& tion. 
15 



1 6 BRIEF DESCRIPTION OF THE DRAWINGS 

17 

1 8 Figure 1 shows a block diagram of a system including techniques involving pre- 

1 9 dictive predownload of templates with delta caching. 
20 

21 Figure 2 shows a process flow diagram of a method of operation of a system in- 

22 eluding techniques involving predictive predownload of templates with delta caching. 

23 
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1 INCORPORATED DISCLOSURES 
2 

3 Inventions described herein can be used in conjunction with technology described 

4 in the following documents: 
5 

6 • U.S. Patent Application Serial No. 09/734,910, (Express Mail Mailing No. EL 768 961 

7 028US), filed December 1 1 , 2000, in the name of Stephane KASRIEL, attorney docket num- 
her 155.1002.01, titled "Predictive Pre-download Using Normalized Network Object Identi- 
fiers", and applications claiming priority therefrom. 

^ •U.S. Patent Application Serial No. 1 0/058,232, (Express Mail Mailing No. EL 734 8 1 5 560 

rffg US), filed October 1 9, 2001 , in the name of Stephane KASRIEL, attorney docket number 

ill ii 

HK? 155.1008.01, titled "Differential Caching with Many-to-One and One-to-Many Mapping", 

04 and applications claiming priority therefrom. 
15 

1 6 These documents are hereby incorporated by reference as if fully set forth herein, 

17 and are sometimes referred to herein as the "incorporated disclosures," 
18 

1 9 DETAILED DESCRIPTION OF THE INVENTION 
20 

21 The description herein includes a preferred embodiment of the invention, includ- 

22 ing preferred data structures and process steps. Those skilled in the art would reahze after pe- 

23 rusal of this application, that embodiments of the invention might be implemented using a vari- 

24 ety of other techniques not necessarily specifically described herein, without undue experimental 
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1 tion or further invention, and that such other techniques would be within the concept, scope, and 

2 spirit of the invention. 
3 

4 Lexicography 
5 

6 The following terms relate or refer to aspects of the invention or its embodiments. 

7 The general meaning of each of these terms is intended to be illustrative and in no way limiting. 

0 

• client and server — These terms refer to a relationship between two elements in a system 
^||) (whether actual hardware devices, software elements, or some combination thereof), particu- 
3Jl larly to their relationship as client and server, not necessarily to any particular physical de- 
^ vices. 

m 

i 54 For example, but without limitation, a particular client (whether a hardware device or a soft- 

1 5 ware element) in a first relationship with a first server, can also be a server in a second rela- 

1 6 tionship with a second client. 
17 

1 8 • client device and server device — These terms refer to devices taking on the role of a cKent 

19 or a server in a client-server relationship (such as an HTTP web client and web server). 

20 There is no particular requirement that any client devices or server devices must be individ- 

21 ual physical devices, or even that they must be hardware entities. They can each be a single 

22 device, a set of cooperating devices, a portion of a device, a single software element, a set of 

23 cooperating software elements, a portion of a software element, or some combination thereof. 
24 
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1 • web server — This refers to a server capable of providing web objects, including web pages 

2 and data elements embedded therein, to requesting clients. 
3 

4 • delivery — in general, sending a web page from a web server to a web client. 
5 

6 • delta information, delta encoding, encoding for delivery — as used herein, the term "delta 

7 information" refers to a selected portion of a web page that may vary between instances of 

^ 8 the web page. Delta encoding and encoding for delivery refer to a process wherein a device 
fp detemiines template information and delta information, provides mapping functions between 
J|) template URLS and server URLs, deUvers information that will be subsequently integrated 
yUl into a web page or other document for delivery to e^n. end user and provides a transparent in- 

42 terface between a client device and a server. 

KSS tt 

m 

• object embedded in or referenced by a web page — in general, an object embedded in or 
I s referenced by a web page includes links to other information such as other web pages. 

16 

1 7 • prediction engine, prediction map — in general, a prediction engine selects one or more 

1 8 objects likely to be requested by the client making the particular request, such as a next page 

19 or an object embedded in or referenced by a page. A prediction map, responsive to web 

20 pages and other objects is maintained by the prediction engine. 
21 

22 • pre-download — in general, to download an object to a client device at a point in time be- 

23 fore the object is requested by a client. 
24 
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1 • template information, template builder - in general, the term "template information" re- 

2 fers to a selected portion of a web page that is relatively unchanging. If there is no difference 

3 between different instances of a web page, then the entire page may composed of template 

4 information. A "template builder" refers to a technique for determining template informa- 

5 tion. De-coupling tiie service of template information from the service of delta information 

6 to a client increases the overall speed of serving the web page. 
7 

.r| • web objects - in general, web pages, data elements embedded in web page and elements of 
"^'S web pages such as template information and delta information. 

s s 

1 1 -i 

"M The scope and spirit of the invention is not limited to any of these definitions, or 

3t to specific examples mentioned therein, but is intended to include the most general concepts em- 

JIf bodied by these and other terms. 

w 

15 System Elements 
16 

17 Figure 1 shows a block diagram of a system including techniques involving predic- 

1 8 tive predownload of templates with delta encoding. 
19 

20 A system 100 includes a set of clients 1 10, a communication network 120, a 

21 server 130, and a predownloader 140. Although the system 100 is described herein with regard 

22 to a single client 1 10 and a single server 130, those of ordinary skill in the art would understand, 

23 after perusal of this application, that the system 100 can also include multiple clients 1 1 0, multi- 

24 pie servers 130, or some combination thereof. Moreover, although the system 100 is described 
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1 with regard to requests for web objects, such as using the HTTP protocol (hypertext transfer pro- 

2 tocol) or a variant thereof, those of ordinary skill in the art would understand, after perusal of this 

3 application, that the system 100 can also or alternatively include other client/server relationships, 

4 and requests for other types of objects. 
5 

6 There is no particular requirement that clients 1 10 are all of the same type or 

7 servers 130 are all of the same type. For one example, some clients 1 10 might use Microsoft's 

I J "Internet Explorer" web browser, while other clients 110 might use the open source "Opera" web 

^ browser. For another example, some servers 130 might use the open source "Apache" web 

ft server, while other servers 1 30 might use another web server. 

i 

J? There is no particular requirement that objects being requested, or protocols used 

0 to request them, are all of the same type. For example, web objects might be requested using 
FTP (file transfer protocol), HTTP, or variants thereof. File objects might be requested using 

1 5 FTP, NFS (network file system), or variants thereof. Database objects might be requested using 

1 6 SQL (structured query language), CORBA (common object request broker architecture), or vari- 

17 ants thereof. 
18 

1 9 Each web client 1 1 0 includes a processor, program and data memory, mass stor- 

20 age, input elements (such as a keyboard or a mouse or other pointing device) and output ele- 

21 ments (such as a monitor or other display and a speaker), and a client cache 111, and is con- 

22 trolled by a user 112. The processor, program and data memory, and mass storage operate in 

23 conjunction to perfomi the fiinctions of a web client 1 1 0 (also known as a web "browser"). The 

24 web client 110 generates outgoing messages 113 including requests for web objects, which it 
EL734815216US 8 
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1 sends to the web server 1 30, and receives incoming messages 1 1 3 including responses to those 

2 requests, which can include data from web objects. In one embodiment, the web client 1 10 uses 

3 the HTTP protocol or a variant thereof, but as noted above other protocols can also or altema- 

4 tively be used. The client cache 1 1 1 includes a portion of the data memory or mass storage, and 

5 is capable of storing copies of data from web objects. 
6 

7 Each web client 1 10 is coupled to the communication network 120. In one em- 

8 bodiment, the communication network 120 includes at least a portion of an Intemet, intranet, ex- 
tranet, virtual private network, enterprise network, another form of conmmnication network, or 

ij) any other network, system, or technique capable of routing messages between and among one or 

11 more web clients 1 1 0 md web servers 130. 

% 

L— 5! 

pfB Each server 1 30 includes a processor, program and data memory, and mass stor- 

i;£4 age. The data memory and mass storage are capable of storing objects 131, such as web pages, 

OS text, images, sounds, programs or program fragments, style-sheets, scripts, and other forms of 

16 data. Each object 131 can include one or more links 132 to other objects 131 (such as other web 

1 7 pages), and can also or alternatively include one or more embedded objects (such as embedded 

1 8 images, scripts, or other data). One or more of the servers 1 30 can also include input elements 

1 9 (such as a keyboard or a mouse or other pointing device) and output elements (such as a monitor 

20 or other display and a speaker), and be controlled by an operator 133. 
21 

22 The processor, program and data memory, and mass storage operate in conjunc- 

23 tion to perform the tunctions of a server 130. In one embodiment, one or more of the servers 130 

24 includes a plurality of devices each capable of acting as a server, cooperating using a load- 
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1 sharing or other distribution technique for dividing the work of responding to requests among 

2 them, and jointly controlled by a single operator 1 33. Where multiple devices operate together, 

3 the server 130 can also be referred to as a "server farm". 
4 

5 The server 1 30 receives incoming messages 1 1 3 including requests for objects, 

6 and generates outgoing messages 1 13 including responses to those requests, which can include 

7 data from web objects. In one embodiment, the server 130 uses the HTTP protocol or a variant 
l3 thereof, but as noted above other protocols can also or alternatively be used. 

5 

® The predownloader 140 includes a delta encoder 141, a template builder 142, a 
predictor 143, a set of template information 144, and a set of prediction information 145. Al- 

3L2 though the predownloader 140 is described herein as a single device, those of ordinary skill in 

I© the art would recognize, after perusal of this application, that the predownloader 140 can be em- 

^ bodied as one or more devices, and including one or more elements such as the delta encoder 

15 141, the template builder 142, and the predictor 143. 
16 

17 There is no particular requirement that the delta encoder 141, the template builder 

18 142, and the predictor 143 are embodied in the same device or element. There can be a separate 

1 9 device or element for each of thrai or some of them. For example, in one embodiment, the delta 

20 encoder 141 and the predictor 143 can be embodied in a first device, while the template builder 

21 1 42 is embodied in a second device. 
22 

23 There is no particular requirement that the delta encoder 1 4 1 , the template builder 

24 142, and the predictor 143 are each single devices or elements. There can be a multiple devices 
EL734815216US 10 
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1 or elements, or some combination thereof, for each of them or some of them. For example, in 

2 one embodiment, there can be multiple delta encoders 141 , multiple predictors 143, and one 

3 template builder 142. 
4 

5 There is no particular requirement that the template information 1 44 or the predic- 

6 tion information 145 are recorded in single databases. There can be a multiple copies of either or 

7 both of them, or there can be separate (and possibly different) copies of either or both of them, or 

i3 some combination thereof For example, in one embodiment, there can be multiple copies of the 

Hi 

t9 same template information 144 collectively used by different servers 130 (with similar data), 

® while there is a separate set of prediction information 145 for each server 1 30. 

jfl From the server 130, the delta encoder 141 receives data for an object 131 to be delivered to a 

12 cKent 1 10. The delta encoder 141 determines if there is a stored template for the object 131 in 

ife the template information 144. The delta encoder 141 calculates deha information for the object 
ft 131, responsive to the object 1 3 1 and responsive to the template information 1 44. The delta en- 

15 coder 141 generates a message 1 13 to the client 1 10 including the delta information and specify- 

1 6 ing the template it used. The client 1 1 0 is capable of presenting the object 1 3 1 in response to the 

1 7 message 1 1 3, by reconstructing the object 1 3 1 in response to the delta information and a tem- 

1 8 plate in the client cache 111. If the client cache 111 does not contain the template, the client 1 10 

1 9 is capable of receiving that template from the server 1 30 and then reconstructing the object 131. 
20 

21 The delta encoder 141 calculates the size of the delta information it calculates for 

22 each object 131, and determines in response to that size, in response to a size for the object 1 3 1 

23 itself, and in response to a threshold value (possibly set by the operator 1 33) whether the delta in- 

24 formation is larger than it "should be." If so, the delta encoder 141 so informs the template 
EL734815216US 11 
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1 builder 142 (using any available technique), thus allowing the template builder 142 to calculate a 

2 new template for the obj ect 1 3 1 . There is no particular requirement for the delta encoder 1 4 1 to 

3 use any particular technique for so informing the template builder 142; it can use a flag or other 

4 information in a database record (including for example marking the template "obsolete"), an in- 

5 terprocess message (including a remote procedure call in systems 100 where the delta encoder 

6 141 and the template builder 142 are not executing on the same hardware device), a network 

7 message (such as a message 1 13 in the system 100), or any other technique capable of allowing 

8 the template builder 142 to understand the results of the calculation by the delta encoder 141 . 
9 The template builder 1 42 calculates templates for selected objects 1 3 1 and records, in the tem- 
,||) plate information 144, one or more of those templates for each of the selected objects 131. Thus, 
M the template information 144 can include multiple templates for one selected object 1 3 1 (such as 
J 2 for example if that object 1 3 1 has been changed more than once recently), can include one tem- 
HS plate for a group of more than one selected object 1 3 1 (such as if those objects 1 3 1 have similar 
||i information), or some combination thereof. In one embodiment, the template builder 142 marks 
% each object with a calculated template with a pointer to, or other indicator for, that template. 

16 In a first embodiment, the template builder 142 calculates templates in response to information 

17 firom the delta encoder 141, indicating that the delta information for a selected object 131 is lar- 

1 8 ger than it "should be." In a second embodiment, the template builder 142 calculates templates 

19 in response to changes in selected objects 131 as each such object 131 is changed at the server 

20 130. In a third embodiment, the traaplate builder 142 calculates templates for all selected objects 

21 131 in a sweep across the entire set of such objects 131 maintained by the server 130. Selected 

22 objects 1 3 1 can include all objects 1 3 1 at the server 1 30, or a subset thereof, where the subset is 

23 determined in response to one or more of the following: 
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1 • object age — Templates are calculated for objects 1 3 1 changed more recently than, or which 

2 are older than, a selected threshold (possibly set by the operator 133), or some combination 

3 thereof. 
4 

5 • object size — Templates are calculated for objects 1 3 1 larger than, or smaller than, a se- 

6 lected threshold (possibly set by the operator 1 33), or some combination thereof. 
7 

8 • object type — Templates are calculated for objects 1 3 1 having one of a first set of selected 

^ types, or not having one of a second set of selected types (possibly set by the operator 1 33), 

^ or some combination thereof For just one example, templates might be calculated for all 

U text objects, but for no sound objects. 

W 

J2 

nM • operator selection — Templates are calculated for objects 1 3 1 selected by the operator 1 33, 

ft individually or in groups. 

% 

16 Those of ordinary skill in the art would recognize, after perusal of this applica- 

17 tion, that any one or more of these embodiments, or some combination thereof, might be used in 

18 the system 100. 
19 

20 The predictor 143 receives the identity of objects 131 requested by the client 1 10 

2 1 (such as by receiving copies of the messages 1 1 3 requesting those objects 131). In one embodi- 

22 ment, each such message 1 13 includes a "referring page," indicating the object 131 just previ- 

23 ously requested by the client 1 10. Using aggregates of this information, the predictor 143 con- 

24 structs a directed graph of likelihood information, indicating for each object 131, what next ob- 
EL734815216US 13 
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1 jects 13 1 are most likely and what is their relative likelihood. The predictor 143 can also or al- 

2 tematively operate by predicting next objects 1 3 1 in response to any links 1 32 present in each 

3 object 1 3 1 , in response to aggregate information for which objects 131 are most likely to be re- 

4 quested independent of the referring page, or in response to other information as further de- 

5 scribed in the incorporated disclosures. 
6 

7 As noted above, if a cUent 1 1 0 receives delta information but does not have cor- 

responding template information, that client 1 10 can request the associated template from the 

C$ server 130. In one embodiment, further described in the incorporated disclosures, the associated 

^ template includes a script that can be executed by the client 1 10, and therefore can be treated by 

si the predictor 143 like any other next object 131. In systems 100 where the associated template 

3^ does not include a script (such as for example where delta encoding is performed using an exten- 

ST if 

p sion or modification of the HTTP protocol), templates for eadi object 13 1 are still treated as next 

® objects 1 3 1 that can be next requested by clients 1 1 0, and whose likelihood of being requested is 

1 5 calculated by the predictor 143. 
16 

17 In response to the predictor 143, the chent 110 and the server 130 cooperate to 

1 8 pre-download (for example, to download to the client 1 1 0 and store in the client cache 1 1 1 be- 

19 fore the user 112 specifically requests that object 131) the template for the object 131. Inafirst 

20 embodiment, the predictor 143 embeds a "hint" in the response message 1 1 3 to the cHent 1 1 0, 

2 1 suggesting a next object 1 3 1 to request if there is any idle time before the user specifically re- 

22 quests an object 131. In a second embodiment, the server 1 30 can generate a message 1 1 3 deliv- 

23 ering the predicted next object 131, independently of an explicit request, which the client 1 1 0 

24 stores in the cUent cache 111. Those of ordinary skill in the art, after perusal of this application, 
EL734815216US 14 
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1 would recognize that the client 1 1 0 and the server 1 30 can operate in many different ways to pre- 

2 download the predicted next object 1 3 1 to the client 1 1 0 and store it in the client cache 1 1 1 , and 

3 that all such techniques are within the scope and spirit of the invention. 
4 

5 hi some embodiments, the client 110 and the server 1 30 can cooperate to deliver 

6 a compressed version of the delta information, the template information, or both, from the server 

7 1 30 to the cUent 1 1 0. Delivering a compressed version of an object 1 3 1 can include either an ex- 
, 8 tension or modification of the HTTP protocol, or can include other techniques; these are both 

3 further described in the incorporated disclosures. The system 100 can flexibly perform compres- 

■P sion, including compressing only the delta information, only the template information, or com- 

1 1 pressing each separately, as further described in the incorporated disclosures. 

Jfe Method of Operation 

ft 

15 Figure 2 shows a process flow diagram of a method of operation of a system in- 

1 6 eluding techniques involving predictive predownload of templates with delta caching. 
17 

1 8 A method 200 is performed by the system 1 00. Although the method 200 is de- 

1 9 scribed serially, the steps of the method 200 can be performed by separate elements in conjunc- 

20 tion or in parallel, whether asynchronously, in a pipelined manner, or otherwise. There is no par- 

2 1 ticular requirement that the method 200 be performed in the same order in which this description 

22 lists the steps, except where so indicated. 
23 
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1 At a flow point 210, predownloader 1 40 is ready to receive a request for an object 

2 131. 
3 

4 At a step 2 1 1 , the predownloader 140 receives a request message 113 from a cli- 

5 ent 1 1 0 for an object 131 from the server 130. The request message 1 1 3 includes a requested 

6 URL. 
7 

Lg At a step 212, the predownloader 140 provides the requested URL to the delta en- 

© coder 141. 

ft 

Si At a step 213, the predownloader 140 receives a referring-page URL, included in 

^ the request message 113. 

At a step 214, the predownloader 140 provides the referring-page URL and the 

ni 

1 5 requested URL to the predictor 143. 
16 

17 At a step 22 1 , the delta encoder 1 4 1 receives the requested URL included in the 

1 8 request message 1 1 3 from the predownloader 140. 
19 

20 At a step 222, the delta encoder 141 searches template information 144 and de- 

2 1 teimines if there is a template for the object 131. 
22 

23 At a step 223, the delta encoder 141 calculates delta information for the object 

24 131. 
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1 At a step 224, the delta encoder 141 determines whether the delta information for 

2 the object 13 1 is too large. In the event that the deha information for object 1 3 1 is too large, the 

3 deha encoder 141 informs the template builder 142 that the delta information for the object 1 3 1 

4 is too large and a new template is generated. 
5 

6 At a step 225, the deha encoder 141 attaches any predownload hint information 

7 for the object 131, from the prediction information 1 45 . 
8 

S| At a step 23 1 , the template builder 1 42 calculates a template for the object 1 3 1 (if 

W needed), and records that template in the template information 144. 

11 

12 At a step 241 , the predictor 143 receives the referring-page URL and the re- 

OJ quested URL from the predownloader 140. The refexing-page URL and the requested URL and 

ft included in the message 113. 

SIS -i 

16 At a step 242, the predictor 143 calculates, in response to the referring-page URL 

1 7 and the requested URL, the likeliest next objects 1 3 1 for the object 131. The likeliest next ob- 

1 8 jects include those objects associated with the object 1 3 1 that the user 1 1 2 is likely to request. 
19 

20 At a step 243, the predictor 143 updates the prediction information for the object 

21 131, including predownload hint information for the object 131. 
22 

23 At a flow point 250, the predownloader 140 is done with the request. The method 

24 200 continues at the flow point 210, where it is ready to receive another request. 
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1 Alternative Embodiments 

2 

3 Although preferred embodiments are disclosed herein, many variations are possi- 

4 ble that remain within the concept, scope, and spirit of the invention. These variations would be- 

5 come clear to those skilled in the art after perusal of tihis application. 
6 

7 Those skilled in the art would realize that any alternative embodiments described 

8 herein are illustrative, and in no way limiting. 

9 

m 

: c 
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